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Gaussian Channel with Noisy Feedback and 
Peak Energy Constraint 
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' Abstract 

(N 

Optimal coding over the additive wiiite Gaussian noise channel under the peak energy constraint is studied when 



there is noisy feedback over an orthogonal additive white Gaussian noise channel. As shown by Pinsker, under the peak 
energy constraint, the best error exponent for communicating an A/-ary message, M > 3, with noise-free feedback 
is strictly larger than the one without feedback. This paper extends Pinsker's result and shows that if the noise power 
in the feedback link is sufficiently small, the best error exponent for conmmunicating an A/-ary message can be 
strictly larger than the one without feedback. The proof involves two feedback coding schemes. One is motivated by 
a two-stage noisy feedback coding scheme of Bumashev and Yamamoto for binary symmetric channels, while the 
^ ' other is a linear noisy feedback coding scheme that extends Pinsker's noise-free feedback coding scheme. When the 

feedback noise power a is sufficiently small, the linear coding scheme outperforms the two-stage (nonlinear) coding 
scheme, and is asymptotically optimal as a tends to zero. By contrast, when a is relatively larger, the two-stage 
coding scheme performs better. 



Index Terms 

Noisy feedback, error exponent, peak energy constraint, Gaussian channel. 

I. Introduction and Main Results 

We consider a communication problem for an additive white Gaussian noise (AWGN) forward channel with 
feedback over an orthogonal additive white Gaussian noise backward channel as depicted in Fig. 1. Suppose that 
the sender wishes to communicate a message S [1 : M] :— {1,2, . . . , M} over the (forward) additive white 
Gaussian noise channel 

Yi = Xi + Zi, 

where Xi, Yi, and Zi respectively denote the channel input, channel output, and additive Gaussian noise. The sender 
has a causal access to a noisy version Yi of Yi over the feedback (backward) additive white Gaussian noise channel 

Yi — Yi ~\- Zi, 
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Fig. 1. Gaussian cliannel with noisy feedback. 



where Zi is the Gaussian noise in the backward Hnk. We assume that the forward noise process {Zi}°^^ and 
the backward noise process {Zi}°^^ are independent of each other, and respectively white Gaussian N(0, 1) and 
N(0,a). 

We define an (M, n) code with the encoding functions Xi{w, y^~^), i € [1 : n], and the decoding function w{y^). 
We assume a peak energy constraint 

xj{w, Y'-^) < np\ = 1 for all w. (1) 
The probability of error of the code is defined as 

pin) ^ ^ WiY")} 

1 

w—1 

where W is distributed uniformly over {1, 2, . . . , M} and is independent of {Z" , Z"). 

As is well known, the capacity of the channel (the supremum of (logM)/n such that there exists a sequence 
of (M, n) codes with lim„^oo ^'i"'' — > 0) stays the same with or without feedback. Hence, our main focus is the 
rehabihty of communication, which is captured by the error exponent 

lim --InPj") 

of the given code. The error exponent is sensitive to the presence of noise in the feedback link. Schalkwijk and 
Kailath showed in their celebrated work ||T| that noise-free feedback can improve the error exponent dramatically 
under the expected energy constraint 

n 

E[a;2(u), Y'-^)] < nP for all w, (2) 

1=1 

(in fact, Pi"^ decays much faster than exponentially in n). Kim, Lapidoth, and Weissman 121 studied the optimal 
error exponent under the expected energy constraint and noisy feedback, and showed that the error exponent is 
inversely proportional to a for small a. 
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Another important factor that affects the error exponent is the energy constraint on the channel inputs — the peak 
energy constraint in ([T]i vs. the expected energy constraint in (|2]i. Wyner |l3l showed that the error probabiHty of 
the Schalkwijk-Kailath coding scheme H) degrades to an exponential form under the peak energy constraint. In 
fact, Shepp, Wolf, Wyner, and Ziv (U showed that for the binary-message case (M = 2), the best error exponent 
under the peak energy constraint is achieved by simple nonfeedback antipodal signaling, regardless of the presence 
of feedback. This negative result might lead to an impression that under the peak energy constraint, even noise-free 
feedback does not improve the reliability of communication. Pinsker Q proved the contrary by showing that the 
best error exponent for sending an M-ary message does not depend on M and, hence can be strictly larger than 
the best error exponent without feedback for M > 3. 

In this paper, we show that noisy feedback can improve the reliability of communication under the peak energy 
constraint, provided that the feedback noise power a is sufficiently small. Let 

Em (a) := lim sup In P* {M, n) , 

n—¥oo ^ 

where P*{M,n) denotes the best error probability over all {M,n) codes for the AWGN channel with the noisy 
feedback. Thus, Em{oo) denotes the best error exponent for communicating an Af-ary message over the AWGN 
channel without feedback. Shannon l6j| showed that 

M 

Em (oo) = — -P. (3) 

This follows by first upper bounding the error exponent with the sphere packing bound and then achieving this 
upper bound by using a regular simplex code on the sphere of radius VnP, that is, each codeword a;"(u)) satisfies 
Sr=i ^f(^) ~ same Euclidean distance from every other codeword. In particular, for M = 3, 

a;"(l) = V^- (0,1,0,..., 0), 

a;"(2) = ■ (-1/2, ^3/2, 0, . . . , 0), 

x"(3) = ■ (-1/2, -V3/2, 0, . . . , 0), 

and 

i?3(oo) = ^P 

At the other extreme, Em{0) denotes the best error exponent for communicating an il/-ary message over the AWGN 
channel with noise-free feedback. Pinsker ijS) showed that 

Em{Q) ^ f 

for all M. In particular, 

^^3(0) = |. 

Clearly, Em (a) is decreasing in a and 

EM{^)<EM{a) <Em{0) 
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for every a and M. 

Is Em (a) strictly larger than Em{oo) (i.e., is noisy feedback better than no feedback)? Does E]\j{a) tend to 
Em{0) as a -> (i.e., does the performance degrade gracefully with small noise in the feedback link)? What is 
the optimal feedback coding scheme that achieves Ei\j{a)7 To answer these questions, we establish the following 
results. 

Theorem 1: For < s < 1, 

EM{a is)) >-^l- ^^(,2 _ 2,s + 4) + 3(M - 2) 
where 

" ~ 4(s2 - 2s + 4) ■ 

By comparing the lower bound with (jS) and identifying the critical point a = a*{l) — 1/4, we obtain the 
following. 
Corollary 1: 

Em (a) > Em (oo) for a < i. 

Thus, if the noise power in the feedback link is sufficiently small, then the noisy feedback improves the reliability 
of communication even under the peak energy constraint. The proof of Theorem 1 is motivated by recent results 
of Burnashev and Yamamoto in a series of papers Q, |[8|, where they considered a communication model with a 
forward BSC(p) and a backward BSCiap), and showed that when a is sufficiently small, the best error exponent 
is strictly larger than the one without feedback. 

The lower bound in Theroem 1 shows that lim inf -E'a/ (a) > 2PM/{7M — 6), which is strictly less than 
Em{0) = P/2. To obtain a better asymptotic behavior for a — > 0, we establish the following. 

Theorem 2: 

. ^ -P 1 
EM{a) > 



> 



2 l + a + ^[M/2\)^a + 4{[M/2\)yUx{^ + a) 
P 1 



2 (VaM + ^/T+aY 
This theorem leads to the following. 
Corollary 2: 

limSM(a) = Sm(0). 

Thus, the lower bound in Theorem 2 is tight for a — > 0. The proof of Theorem 2 extends Pinsker's linear 
noise-free feedback coding scheme to the noisy case. 

Fig. |2] compares the two bounds for the il/ = 3 case. The linear noisy feedback coding scheme performs better 
when a is sufficiently small, while the two-stage noisy feedback coding scheme performs better when a is relatively 
larger. 

The rest of the paper is organized as follows. In Section II, we study a two-stage noisy feedback coding scheme 
motivated by recent results of Burnashev and Yamamoto and establish Thereom 1. In Section III, we extends 
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Fig. 2. Comparison of the two noisy feedback coding scheme for M = 3. 



Pinsker's noise-free linear feedback coding scheme to the noisy feedback case and establish Theorem 2. Section IV 
concludes the paper. 

II. Two-stage Noisy Feedback Coding Scheme 

A. Background 

It is instructive to first consider a two-stage noise-free feedback coding scheme for M — 3. This two-stage 
scheme has been studied by Schalkwijk and Barron [9| and Yamamoto and Itoh ifTOl for a general M. 

Encoding. Fix some A e (0, 1). For simplicity of notation, assume throughout that An is an integer. To send 
message w e [1 : 3], during the transmission time interval [1 : Xn] (namely, stage 1), the encoder uses the simplex 
signaling: 



y/XnP- (0, 1,0, ...,0) forw^l. 



VXnP-{-l/2,VS/2,0,...,0) forw = 2, (4) 
VAnP- (-1/2,-73/2, 0,...,0) for w = 3. 
Based on the feedback y^", the encoder then chooses the two most probable message estimates wi and W2, where 

P{wi\y^n > P{w2\y^n > P{w3\y^n (5) 

and in case of a tie the one with the smaller index is chosen. Since the channel is Gaussian and W is uniform, Q 
can be written as 

- /"II > \\X^'\W2) - /"II > ||x^"(^i3) - /"II, 
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where || • || denotes the Euclidean distance. During the transmission time interval [Xn+ 1 : n] (stage 2), the encoder 
uses antipodal signaling for w if w G {u>i,W2} and transmits all-zero sequence otherwise: 



^(1 - X)nP ■ (1,0,0,...,0) ifw = min{u;i,W2}, 



^(1 — X)nP ■ (—1,0, 0, . . . , 0) if ui = max{u)i, W2}, 

(0,0, ...,0) otherwise. 

Decoding. At the end of stage 1, the decoder chooses the two most probable message estimates wi and W2 based 
on F'^" as the encoder does. At the end of stage 2, the decoder declares that w is sent if 

w = arg min ||a;"(w) — y"|| 

w£{wi,W2} 

= arg min. (||x^"(z.) - + ||xL+i(«^) - yL+ilP)'^'- 

Analysis of the probability of error. Let Wi and W2 denote the two most probable message estimates at the end 
of stage 1. The decoder makes an error if and only if one of the following events occurs: 

Si^{W ^ Wi and W ^ W2}, 
£2^ {W e {Wi,W2} and W ^W}. 

Pi") - P(f 1) + P(£2). 



Thus, the probability of error is 



By symmetry, we assume without loss of generality that W ^ 1 is sent. For brevity, we do not explicitly condition 
on the event {VF = 1} in probability expressions in the following, whenever it is clear from the context. Refering 
to Fig. 12 let 

A23 = {y^": |k'"(l) - 2/^" 1 1 > ||x^"(2) - /"II and ||a;^"(l) - y^"|| > ||x^"(3) - 2/^"||}, 

we have 

P(fi) = P{r^" e A23} 

< Q{di) 

1 / XnP 



< 



■ exp 



2 " V 2 

where (a) follows since Q{x) < (1/2) exp(-x2/2) for a; > (see (HI] Problem 2.26]). 

On the other hand, P(£2) is determined by the distance between the simplex signaling in stage 1 and the distance 
between the antipodal signaling in stage 2 (see Fig. |4|l. In particular, 

||X"(W^i) - X"(t^2)|| = + = v/(4 - A)nP. 

Thus, 
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P{S2) = Q 



= Q{,l{l-^]nP 



Therefore, the error exponent of the two-stage feedback coding scheme is lower bounded as 

E's (0) = lim sup - - In Pj") 

= lim sup max{ln P(^i), In P(^2)} 

n— >-oo ^ 

^ . JAP P/ A 
> mm'^ , — 1 

Now let A = 4/5. Then it can be readily verified that both terms in the minimum are the same and we have 

op 

^3(0) > E'M > 

Remark 1: Since .£3(0) = P/2, this two-stage noise-free feedback coding scheme is strictly suboptimal. 
Remark 2: We need only three transmissions: two for stage 1 and one for stage 2. Thus A actually divides only 
the total energy nP, not the block length n. 
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B. Two-stage Noisy Feedback Coding Scheme 

Based on the two-stage noise-free feedback coding scheme in the previous subsection and a new idea of signal 
protection introduced by Burnashev and Yamamoto Q, ID, we present a two-stage noisy feedback coding scheme 
for M = 3. The coding scheme for an arbitrary M is given in Appendix A. 

In the two-stage noise-free feedback coding scheme, the encoder and decoder agree on the same set of message 
estimates wi and W2 at the end of stage 1. When there is noise in the feedback Hnk, however, this coordination is 
not always possible. To solve this problem, we assign a signal protection region S^, w e [1 : 3], to each signal 
a;'^"(w) as depicted in Fig. |5] Let x'^" and y^" denote the transmitted and received signals, respectively, and y^" 
denote the feedback sequence at the encoder Let d' — ||a;'^"(l) — x'^"(2)|| = v3AnP and the signal protection 
region Bw for w G [1 : 3], is defined as 

= {y^": < - y"^"!! for w' ^ w and 

lllx^^K) - -y^"||| < td' for w',w" ^w} (6) 

which means that message w is the most probable and the other messages w' and w" are of approximately equal 
posterior probabilities. Here t £ [0, (a/3 — l)/2] is a fixed parameter which will be optimized later in the analysis. 

Encoding. In stage 1, the encoder uses the same simplex signaling as in the noise-free feedback case (see (|4|). 
Then based on the noisy feedback y^", the encoder chooses wi and W2 such that 

In stage 2, the encoder uses antipodal signaling for w if w e {wi, W2} and transmits all-zero sequence otherwise. 

Decoding. The decoder makes a decision immediately at the end of stage 1 if the received signal lies in one of 
the signal protection regions, i.e., y'*'" e for w E [1:3]. Otherwise, it chooses the two most probable message 
estimates wi and W2 and wait for the transmission in stage 2. At the end of stage 2, the decoder declares that w 
is sent if 

w = arg min ||a;"(u') — y"|| 

= arg min_ (||x^"H - + \\xl,^,H - yL+ilP)'^'- 

Remark 3: The signal protection region corresponds to the case in which the two least probable messages are 
of approximately equal posterior probabilities, i.e., ||2;'^"(u') — y^"\\ ^ — ~ \\x^^{w") — y^^W- 

Analysis of the probability of error. Let (Wi, W2) and {Wi, W2) denote the pairs of the two most probable 
message estimates at the encoder and the decoder, respectively. As before, we assume that W ~ lis sent. Refering 
to Fig. E] let 

where ||y^" - a;^"(?i;")|| > max{||y^" - a;^"(w)||, ||y^" - w" ^w,w'}. 

The decoder makes an error only if one or more of the following events occur: 
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Fig. 5. Signal protection regions. The shaded areas Su, for to = 1,2, 3 are the signal protection regions for x^"{l), x-^"{2), and x^^{3), 
respectively. Here ^4 = sdi/2 = (s/2)\/ \nP for some parameter s = s(t) g [0, 1] to be optimized later 



• decoding error at the end of stage 1 

• miscoordination due to the feedback noise 

£12 = {r^" G A'i2,y^" G ^13UA23}, 

£13 = {Y^" G A'i3,^^" G A,2 U A23}, 

• decoding error at the end of stage 2 

£2 = {VK e {W^i, = {1^1,1^2} and W ^ W}. 
Thus, the probabiHty of error is upper bounded as 

P^'"^ < P{£i) + P{£i2) + P{£i3) + P{£2) 

- P(£l)+2P(£i2) + P(f2). 

To simpHfy the analysis, we introduce a new parameter s e [0,1] such that = sdi/2 = (s/2)\/ XnP. It 
can be easily checked that s G [0, 1] corresponds to t G [0, (\/3 — l)/2] and that this constraint guarantees that 
ds — minj,A,i£^/_^y52UB3 ~ (see Fig. |6ta)). Hence, for the first term 

P(fi) = P{y^"G A^3UB2US3} 

< 2Q(d5) (7) 

<exp _^(s2-2s + 4) . 



10 




The second term P{£2) can be upper bounded (see Fig. |3b)) as 

P(fi2) = P jr^" e A[^,Y^^ e A13 u A23} 
<P{f^"e^i3UA23|r^"eA'i2} 



<2Q(^) (8) 



< exp 



32a 

Finally, the third term P(53) can be upper bounded in the exactly same manner as in the noise-free feedback case: 

P(^3)<iexp(-i(l-^)nP 
Therefore, the error exponent of the two-stage noisy feedback coding scheme is lower bounded as 

£;^(a) =limsup--lnPi") 

> lim sup - - max{ln P (£1 ) , In P (£i 2 ) , In P (f 2 ) } 

n—>oo 

■ , 2 3As2p P { 1 



Now let 



and 



a = a [s) 



4(s2 - 2s + 4) 
4 



A = A*(s)^- ^ ^ 
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Then it can be readily verified that all the three terms in the minimum are the same and we have 



Note that if s < 1, 



(s) > ^P = i?3(oo), 



and a*{s) is monotonically increasing over s G [0, 1]. Thus 

£^3(0;) > £^3(00) for a < a*(l) = i. 

This completes the proof of Theorem 1 for the M = 3 case. 

Remark 4: It can be easily checked that the lower bound in (|9|l is tight and characterizes the exact error exponent 
E'^{a) of the two-stage noisy feedback coding scheme. 

III. Linear Noisy Feedback Coding Scheme 

A. Background 

It is instructive to revisit (a slightly simplified version of) the linear noise-free feedback coding scheme by 
Pinsker |5 |, which shows that Em{0) > £2(00) = P/2 for all M > 2. This lower bound is tight since £2(0) = 
£2(00) [4 1 and Em{0) is nonincreasing in M. 

Encoding. To send message w E [1 : M], the encoder transmits 

{ L+i-w ^ ifAf = 2L + l, 
(10) 
L+II^^ ifM = 2L. 

Because of the feedback Yi, the encoder can learn the noise Zi — Yi — Xi. Subsequently it transmits 

and Xi ^ Q afterwards, where S > will be optimized later and the random time rj = ri{w, Z") is the largest 
k < n = ^/n such that 

fc 

Y,X}<nP. 

i=l 

Decoding. Upon receiving F", the decoder estimates Xi by 

" V. 



and declares that w is sent if 



w = are min \Xi{w) — Xi\. 

we[l:M] 



Remark 5: It can be easily checked that each time i G [2 : 77], the encoder transmits the error 



^7 I ^4-1 



j=i 
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in the decoder's current estimate of the initial transmission (up to scaling). Thus, Pinsker's coding scheme is another 
instance of iterative refinement used in the SchaUcwijk-Kailth coding scheme 111 for the Gaussian channel and the 
Horstein coding scheme |12| for the binary symmetric channel. 

Analysis of the probability of error. For simplicity of notation, assume throughout that n — y/n is an integer. 
We use e„ to denote a generic sequence of nonnegative numbers that tends to zero as n — > oo. When there 
are multiple such functions en\e^\--- ,eit\ we denote them all by e„ with the understanding that e„ = 
ma,x{en\ en\ ■ ■ ■ lejf'}- It is easy to see that decoding error occurs only if — Xi\ > \/~P/{2L). The 

probability of error is thus upper bounded as 

p{n) ^ ^W}< p(|Xi - 111 > ^ 



2L 



The key idea in the analysis is to introduce a "virtual" transmission 

Xi iii = 1, 



Let 



and define the estimate X'l of X[ as 



(l + (5)Z,_i ifie[2:n], 
otherwise. 

Y! = X' + Z,; 



Then, it can be easily shown that 



X[= Xi + {-lf-^ 



Y' 



(1 + (5)^-1 



(l + <5)'- 



Thus we have 



\Xr - ^il > ^1 < Ppi - K\ + \x[-M>i^ 



<p^|Xi-x;i>^^ + p{|x{-Xi|>o} 



=: Pi + P2 



(11) 



(12) 



(13) 



Now we upper bound the two terms. For the first term, we have 



Pi = P 
= 2Q 
< exp 



> 



P 

'2L 



fi-i 



(l + (5)«-i 

P(l + S ) 
2L 

P(l + (5)2("-i) 
8^2 



13 



For the second term, note that Xi = for all i if and only if -^f — '^^'^ '^^us that X[ ^ Xi only if 

127=1 > iT-P- Therefore, 



P2 < P|f]x2 >nF| 

'-4=1 ' 

< P|X^(1 + Sfzl, >{n- l)p\ 



^pf 2 ^ {n-l)P \ 
(l + (5)2 J' 

where (a) follows since < P (recall (fTol l) and Xn-i denotes a chi-square random variable with fi — l degrees 
of freedom. By upper bounding the tail probability of the chi-square random variable fT3 1 as 

P{Xfe > 2;} < exp I 1 — log — j for any fc > 1 and x > k, (14) 

2 2 k 



we have 



, V {n - 1)P 



l{n-l)P n-1 e{n-l)P 



-""Pi ~2TrT^ + ^l°S(n-l)(l + 5)2 
, 1 (n - 1)P n - 1 e{n - 1)P 

1 nP 



< exp 



2(1 + (5)2 

where e„ tends to zero as n — > 00. Therefore, the error exponent of the linear feedback coding scheme is lower 
bounded as 



E'lli (0) > lim sup - i In P^") 



n 

lim sup max{ In Pi , In P2 } 

n— ^00 



> lim sup min 



P(l + (5)2(fi-i) P 



for any 6 > 0. Now let 



5 = S{n) 



8nL2 ' 2(1 + (5)2 
ln(4ni2) 



2n ' 

which tends to zero as n ^ 00. Then the limits of both terms in the minimum are the same. Therefore, 

P P 



E'MiO) > lim sup ; 



2(l + (5(n))2 2 
which completes the proof of achievability. 



B. Linear Noisy Feedback Coding Scheme 

Now we formally describe and analyze a linear noisy feedback coding scheme based on Pinsker's noise-free 
feedback coding scheme. 

Encoding. Fix some A e (0,1). To send message w G [1 : M], the encoder transmits 



ifA/==2L+l, 



Xi{w) = { " (15) 
^+'/^"'" yA^ if M - 2L. 

Because of the noisy feedback Yi, the encoder can learn Zi + Zi =Yi — Xi. Subsequently it transmits 

X, = (l+,5)(Z,_i + Z,_i), ie[2:77], 
where 5 > will be optimized later and the random time r/ = 77 (w, Z", Z" ) is the largest k < n — ^Jn, such that 

i=l 

Decoding. Upon receiving F", the decoder estimates Xi by 

n 

■i— 1 

and declares that w is sent if 

w = are min \Xi{'w) — Xi\. 

Remark 6: The main difference between this noisy feedback coding scheme and Pinsker's noise-free feedback 
coding scheme in the previous subsection is that we let the power of the initial transmission grow linearly with the 
block length n and thus that the initial transmission contains much more information about the message than in 
Pinsker's scheme. This makes the coding scheme more robust to combat the noise in the feedback hnk. 

Analysis of tlie probability of error. As before we assume that n — ^/n is an integer. Let 

Xx if i = 1, 

X'= <: (l + 5)(Z,_i ifze[2:n], (16) 
otherwise, 
and let F/ and X'^ be defined as in ( fT2] i and ( flj] ). Then, it can be easily shown that 



Thus we have 



pin) ^ _^ ^1 

< p||Xi-li 



2L J 



< pjixi - x(| > ^1 + P{\X[ - Xil > 0} 

=: Pi + P2. 



Now we upper bound the two terms. For the first term we have 



Pi = P 
= 2Q 



{-ly 



z,. 



2L 



+ 

) 



z, 



> 



2L 



f XnP\ 



where 



n-l 



N = y ^ 



+ 



^ (l + ^)2(i-l) (l + 5)2(n-l) 



a 1 



(l+5)2(fi-2) 



^ IT+3F 
a(l+(5)2 



(l + (5)2(»-i) 



(1 + (5)2-1 



where e„ tends to zero as n ^ oo. Thus 



/ AnP/ a(l+^ 



For the second term, we have 



P2 < Plj2^i > "-^1 



(1 - X)nP 
(1+ ,5)2(1 + a) 
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where (a) follows since Xi < XnP (recall (fTSll). By ( fT4] l. we have 

P2 < P{xl-i > 



2 . (1 - A)nP 



(1 + 5)2(1 + a) 

1 (l-A)nP n-1, e(l-A)nP 
<exp - - . \ , . +^— log- ^ ' 



2(1 + ,5)2(1 + a) 2 '=(n-l)(l + <5)2(l + a) 

1 (l-A)nP \ 
<exp - - , , +ne„ , (18) 



2 (1 + 5)2(1 + a) 

where Cn tends to zero as n cx). Therefore, the error exponent of the linear noisy feedback coding scheme is 
lower bounded as 



E'Ij (a) = lim sup - - In Pj") 



n 

lim sup max{ln Pi , In P2 } 

n— ^00 ^ 



> min 



AP (1 + 5)2-1 (l-A)P 



Now let 



and 



8i2a (1 + 5)2 ' 2(1 + 5)2(1 + a) 



1/2 



5 = 5(a)=(l + V^) -1 



A = X{a) = 1 + 



1 + a 



4L2a^ 

Then it can be readily verified that both terms in the minimum are the same and we have 

EMia) > 5 , (19) 

^ - 2 l + a + 4(LAf/2j)2a + 4(LM/2j)^a(l + a) 

which completes the proof of Theorem 2. 

Remark 7: It is shown in Appendix B that the lower bound in ( fT9] l is tight and characterizes the exact error 
exponent E'lj{a) of the linear noisy feedback coding scheme. 

IV. Discussion 

When a is very small, the linear feedback coding scheme (which is optimal for noise-free feedback) outperforms 
the two-stage (nonlinear) feedback coding scheme. When a is relatively large, however, linear feedback coding 
scheme amplifies the feedback noise, while the two-stage scheme achieves a more robust performance via signal 
protection. While this dichotomy agrees with the usual engineering intuition, it would be aesthetically more pleasing 
if a single feedback coding scheme performs uniformly better over all ranges of a, and the search for such a coding 
scheme invites further investigation. We finally note that a* = 1/4 is the threshold for all M in the two-stage noisy 
feedback coding scheme (see Appendix A). In both schemes, the error exponents are strictly larger than those for 
the no feedback case only when a is sufficiently small. Thus it is natural to ask whether the noisy feedback is 
useful for all a or there exists a fundamental threshold beyond which noisy feedback becomes useless. 
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Appendix A 
Proof of Theroem 1 for the General Case 

Encoding. In stage 1, the encoder uses the simplex signaling for an Af-ary message: 

for w e[l : M], 



,0). 

w — l 

Then based on the noisy feedback y'*'", the encoder chooses the two most probable message estimates wi and W2 
among M candidates. In stage 2, the encoder uses antipodal signaling for w \f w ^ {tDi, 'W2} and transmits all-zero 
sequence otherwise. 

Decoding. The signal protection region for the A/-ary message is defined as in (|6]l (with w, w', w"e [1 : M]). 
The decoder makes a decision immediately at the end of stage 1 if the received signal y^" lies in one of the signal 
protection regions. Otherwise, it chooses the two most probable message estimates wi and W2, and wait for the 
transmission in stage 2. At the end of stage 2, the decoder declares that w is sent if 

w = arg min_ {\\x'"{w) - + \\xl„+,{w) - yL+ilP)'^'- 

W£{WI ,W2 } 



M 

e,, 



where A = ^M\nP/{M - 1) and 



M 

W—l 



e„ = (O,--- ,0,1,0,' 



Analysis of the probability of error. Let (Wi, W2) and (Wi, W2) denote the pairs of the two most probable 
message estimates at the encoder and the decoder, respectively. The decoder makes an error only if one or more 
of the following events occur: 

• decoding error at the end of stage 1 

• miscoordination due to the feedback noise 

£iw = {y^"' e and y^" e yJ{u,',w"}^{iM^^'^"]^ 

• decoding error at the end of stage 2 

£2 = {W {Wi,W2} = {Wi,W2} and W + W). 
Thus, the probability of error is upper bounded as 

Pi"^ < P(fi)+MP(fi^) + P(f2). 
As before, we assume that W = 1 was sent. For the first term, by the union of events bound, 

P(fi) = P {y^" e u^^iB™ u (u^,«,'#iA:,^0} 
< M^Pjr^" e B2U A23}. 

For P{£i^), again by the union of events bound, 

P(fi„) = P {r^" e and f ^" e U{„,,„,,}^{i,^}A^.^»} 
< m2 p {r^" e and f^" e 

We use d'j, j E [1:6], to denote the distances corresponding to dj in the M = 3 case (see Fig. |6]l. It can be easily 
checked that d'j — dj \/3{M — 1)/(2M). Thus by replacing c?5 by d!^ in (I?) and by in ([8]), we have 

P(fi) < Af2g(4) < — exp [- ^^^^^ _ AnP(g^ ^ 2g + 4) j 

and 

The third term ^{£2) can be upper bounded in the same manner as for the M = 3 case. 



^ 1 ^ (^^ (i A 
- 2 ''^^ V~ V ~ 2(M - 1) 
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Therefore, 

E'm (a) = lim sup - - In Pj") 



Now let 



and 



n 

> lim sup -- max{ln P(f i), In P(f 12), In P{£2)} 

n—^oo ^ 

. r AMP ,2 . .X s^AMP P/ M-2 , 
-"^^n i2(M-l) ^^ + 16(M-l)a ' 2i'-2(M^^ 



a = a (s) = 



4(s2 - 2s + 4) 



V6(M-1)' ' 2(M-1)^ 

Then it can be readily verified that all the three terms in the minimum are the same and we have 

Note that if s < 1, 

and a*{s) is monotonically increasing over s € [0, 1]. Thus 

E'j^^{a) > Em{oo) for a < a*(l) = ^. 

This completes the proof of Theorem 1 for the general case. 

Remark 8: Note that E'j^{a) is decreasing in M, while a*{s) is still independent of M. 
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Appendix B 
E'lj{a) IS Tight 

Now we show that E'lj{a) is the exact error exponent for the linear noisy feedback coding scheme. Consider 

pj") = P{W ^ W) 

>AP{W^W\W& [2:M-1]} 



APi iXi-Xil > 



2L 



= AP\\{X,-X[)-{X[-X,)\>^'^ 
> ApjlXi - X[\ > and \X[ - 111 = o| 

'§APU-X[\>^.na±x!<np] 
^ i=i ^ 

= a( pjlXi - 1(1 > ^1 + pI^±X^ > np}) , (20) 

where A = {M - 2)/M and (a) follows since X;f=i ^ impUes \X[~ X\ =0. Combining (|20ll with the 
fact that the upper bounds (fTTT i and ( fTSl l are both tight in exponent, we conclude that E'lj{a) is the exact error 
exponent for the linear noisy feedback coding scheme. 



